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Abstract. With recent observational advancements, substantial amounts of 
photometric and spectroscopic eclipsing binary data have been acquired. As 
part of an ongoing effort to assemble a reliable pipeline for fully automatic data 
analysis, we put Powell's direction set method to the test. The method does not 
depend on numerical derivatives, only on function evaluations, and as such it 
cannot diverge. Compared to differential corrections (DC) and Nelder & Mead's 
downhill simplex (NMS) method, Powell's method proves to be more efficient in 
terms of solution determination and the required number of iterations. However, 
' ^ , its application is still not optimal in terms of time cost. Causes for this deficiency 

■ are identified and two steps toward the solution are proposed: non-ortogonality 

| of the parameter set should be removed and better initial directions should 

£f} . be determined before the minimization is initiated. Once these setbacks are 

f**". ■ worked out, Powell's method will probably replace DC and NMS as the default 

<^> minimizing algorithm in PHOEBE modeling package. 
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1. Introduction 



One of the most important changes in observational astronomy of the 21st Cen- 
tury is a rapid shift from classical object-by-object observations to extensive 
automatic surveys. As CCD detectors are getting better and their prices are 
getting lower, more and more small and medium-size observatories are refocus- 
ing their attention to detection of stellar variability through systematic sky- 
scanning missions. This tren d is aditionally p owered by the success of pioneer - 
ing sur veys such as ASAS (iPoimanskil I1997T). DENIS (lEpchtein et al.l fl997f ). 



OGLE (|Udalski et al.lll997lh TASS (iBichmond et al.ll2000D . their space counter- 



part HIPPARCOS (llViTvinau fc ESAI I1997) and others. Such surveys produce 
massive amounts of data and it is not at all clear how these data are to be re- 
duced and analysed. This is especially striking in the eclipsing binary (EB) field, 
where most frequently used tools are optimized for object-by-object analysis. A 
clear need for thorough, reliable and fully automated approaches to modeling 
and analysis of EB data is thus obvious. This task is very difficult because 
of limited data quality, non-uniform phase coverage and parameter interdepen- 
dence In an ongoing effort to create an automatic EB reduction pipeline, we put 
Powell's direction set method to the test. To the best of our knowledge, Powell's 
direction set method was never used before for solving the inverse problem of 
EBs. 
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The Method 



Often neglected and overlooked, Powell's direction set method 1 ( Brentl Il973l . 



Chapter 7) is a derivativeless multi-dimensional method that utilizes 1-dimensi- 
onal minimization algorithm along a chosen direction in parameter hyperspace. 
It is quadratically convergent, which makes it one of the fastest methods for 
solving non- linear minimization problems. 

The basic idea of Powell's method is to select a starting point P(pi, . . . ,p n ) 
in parameter hyperspace, and minimize the cost function along some chosen 
direction vector n us ing 1-D minimizer such as bracketing or Brent's parabolic 
method (|Brentl 1197.1 Chapter 5). There is a wealth of direction set method 



derivatives which differ on ly on how and at which point of iteration is the next 
direction vector n chosen ( Press et al.lll986h . The most appreciated scheme for 



choosing successive directions is the conjugate gradient method, which we now 
briefly describe. 

When the cost function is minimized along the direction n, the gradient in 
the obtained minimum is necessarily perpendicular to that direction. If it were 
not, that would mean that the projection of the gradient to that direction is 
non-null, which would in turn mean that the point was not really a minimum. 
The cost function may be expanded in Taylor series around that minimum: 

= /(P)-b-p + ipt.H- P , (i) 

where b is the negative gradient of / and H is the Hessian matrix of second 
partial derivatives of / at P. The gradient is then simply expressed as: 

V/(P)=Hp-b. (2) 

From Eq. © we may immediately deduce the change of the gradient along the 
chosen direction: 

5(V/(P))=<y(H-p-b) = H-(5p). (3) 

To adopt the best possible direction from the found minimum P, the method 
must seek an orthogonal (conjugate) direction to the former direction vector, 
which obviously has to point along the direction of the gradient. If the former 
direction is denoted with n and the new direction is denoted with m, then: 

n-«5(V/(P)) = n-H-m = 0. (4) 

When Eq. Q) holds for vectors n and m, they are said to be conjugate. 
For as long as the minimization is done only in conjugate directions, a single 
minimization along a given direction is necessary, which implies quadratic con- 
vergence. Note that there is no need to compute the gradients at any point 
- only the orthogonality condition is used. This enables Powell's direction set 
method to preserve its derivativeless nature. 



1 Al though the m ethod is still referred to as Powell's method, the algorithm actually used is due 
to IBrentl 119731) . who pointed out and corrected several flaws of Powell's original algorithm. 
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( a ) Unitless effective potentials defined 
bv lWilsonl (Il979h . 

^ go = 1cm s -2 is introduced so that 
the logarithm acts on a dimension- 
less variable. 



Table 1. Light curves in B and V passbands, star shapes and principal 
parameters of the simulated binary. 



3. Simulation 

To assess the successfulness of Powell' s direction set method for EBs, we imple- 
mented the algorithm in PHOEBE 2 (|Prsa fc ZwitteJ l2005al ) . For comparison 



purposes the simulation setup is identical to th at of Nelder & Mead's downhill 
simplex benchmarking ( Prsa Sz Zwitterl 12005 it ) . Namely, we built a partially 



eclipsing synthetic main-sequence F8V-G1 V binary with its principal parame- 
ters listed in Tabled 

In the simulation we have displaced parameters marked for adjustment (in- 
clination i, temperature ratio r = I2/T1, potentials Qi and Q2) U P to ~ 50% 
from their correct values and started the minimization from each starting point. 
Attractors - regions in parameter hyperspace that attract most convergence 
traces - reveal the shape of the minimum and parameter correlations that lead 
to degeneracy issue s. This method is known as heuristic scanning (HS) and is de- 
scribed in detail bv lPrsa fc Zwitteil (|2005aT ). During HS, only Powell's direction 
set method was used. Additionally, passband luminosities L\ were computed 



2 PHOEBE stands for PHysics Of Eclipsing BinariEs and is freely downloadable from 
http: //phoebe. fiz.uni-lj.si It is based on the modeling principles of the WD code 
(Wilson fc Devinnev 1971; Wilson 1979). 
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Figure 1. Heuristic scan cross-sections between potentials f2i, 0,2, inclina- 
tion i, secondary star temperature T2 and the normalized x 2 cos t function 
value A. Panels depict cross-sections between Sli-i (upper left), f2i-f22 (upper 
right), SI1-T2 (lower left) and fii-A (lower right). Shades of gray symbolize 
the goodness-of-fit value, black being best and white being worst. Cross-hairs 
denote the right solution. 



instead of being fitted and color index constraining was used to disentangl e ef- 
fective temperatures of individual components (see IPrsa fc Zwitterl (|200(tI ) for 
rationale and details of color index constraining). 

Compared to other minimization methods implemented in PHOEBE, name- 
ly differential corrections (DC) and Nelder and Mead's downhill simplex method 
(NMS), Powell's method stands out for two reasons: 1) the solution found by 
HS is significantly better determined than by the other two methods. Since 
DC is based on computing and evaluating derivatives, it is known to diverge 
when parameters are not close to the minimum. NMS on the other hand always 
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Average: 4.3 ±1.2 iLcraLions 



Number' of iterations (Powell's method) 



Figure 2. Comparison between the number of iterations required for conver- 
gence to the fractional accuracy 10 -3 in all physical parameters for Nelder and 
Mead's downhill simplex (NMS) method (left) and Powell's method (right). 
Clearly Powell's method is superior to the NMS. Note, however, that the num- 
ber of iterations does not directly translate to the number of function evalu- 
ations (and thus time cost): within 1 iteration Powell's method performs line 
minimization along the chosen direction, which may in some circumstances 
imply many function evaluations. 



converges, b ut the HS solut i on nee ds to be focused by subsequent parameter 
kicking (c.f. iPrsa &; Zwitterl ( 2005ah and Fig. 6 therein). Powell's method is 
superior in this respect because the solution depicted on Fig. ^ is determined 
without any need for additional focusing. Panels show the cross-sections between 
fitted parameters: potentials Sli and O2, the inclination i, secondary star's ef- 
fective temperature T2 and the normalized x 2 cos t function value A. Emerging 
shapes of the obtained minima indicate regions (rather than individual points) 
that contain the solution; 2) the required number of iterations to reach the de- 
sired fractional accuracy in parameter values is significantly lower than that of 
DC or NMS. Fig. [21 depicts the comparison between the number of iterations 
required by the NMS method (left) and Powell's method (right). It should be 
stressed, however, that the number of iterations does not directly translate to 
the number of function evaluations: Powell's method performs line minimization 
in each iteration. If this minimization is performed in a direction along which 
the fitted parameters are correlated, it will require many function evaluations. 
This implies that the time cost of the overall computation does not scale with 
the number of iterations directly but rather depends on solution degeneracy and 
topology of the hyperspace. Still, given the problem at hand, Powell's method 
required roughly 5 times less CPU time than the NMS. 



4. Conclusion and Discussion 

Powell's method provides a solid base for further studies dedicated to solving the 
inverse problem for EBs in a fully automatic manner. There are two important 
problems that need to be worked out in order to optimize the application of 
this method: 1) the non-ortogonality 3 of parameter hyperspace due to classical 



3 By non-ortogonality we mean parameters explicitly depending on other parameters. For exam- 
ple, effective potential Q explicitly depends on the mass ratio q and the synchronicity parameter 
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formulation of the problem needs to be removed, which will eliminate problem- 
atic directions for line minimization and thus significantly reduce the number 
of function evaluations, hence the time cost; 2) seek alternate algorithms for 
determining subsequent sets of directions that would better suit the problem at 
hand. In particular, initial directions that are now set along individual param- 
eters could be better estimated by the singular value decomposition (SVD): a 
method that quantifies the influence of a given parameter on the fit. This way 
the method could rapidly descend toward the minimum in the initial iteration 
already. Although Powell's direction set method seems to be most promising for 
automatic modeling and analysis, its time cost is still significant for large-scale 
surveys and needs to be furtherly reduced in future. 
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